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RELATED APPLICATIONS: 
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1 



BACKGROUND : 

The present invention relates to Query and Response 
information retrieval systems and, more particularly, to 
such systems capable of receiving a user entered question, 
processing the data representing the question, searching 
local and/or web based databases for information relevant 
to an answer to user's query, and conveying such answer 
information to the user. 

Systems of this general type are known that enable a 
user to access a preprocessed database of predetermined 
standard answers to a predetermined set of user queries. 
The standard system responds to a user-entered query by 
processing the query to determine one or a combination of 
key words. The system includes a look-up table to 
determine which predetermined, stored standard answer or 
answers have the key word or combination of key words may 
be responsive to the query. The system activates a link to 
the predetermined, stored answer (sentence) that includes 
the matched key word(s) between the user query and the 
look-up table. 



Such known systems are quite limited in the scope or 
subject matter of the queries that the system can properly 
process. For example, if user query comprises words that 
lack all the key words pre-stored in the look-up table, 
then the system cannot respond with any stored answer or it 
may respond with an incorrect prestored answer. Also, the 
known systems are limited to a particular subject matter, 
such as shareholder inquiries of a particular stock 
company, in order to focus the queries on more likely pre- 
stored key words. 

Accordingly, there is a need for a system that does 
not rely on pre-stored key work matching and that can 
process the user query to gain an understanding of 
information or concepts requested, then searching 
preprocessed and knowledge bases of storing candidate 
concepts with links to databases of full documents in which 
such concepts appear. In addition, there is a need for 
such a system that can dynamically search all databases of 
stored documents on the World Wide Web for concept (s) in 
the user query, downloads candidate documents, processes 
them dynamically to determine if the downloaded document 



contains an answer to the query. If it does, then 
extracting the answer and presenting it to the user and 
adding the query , answer , and document link to the answer 
database . 

SUMMARY OF EXEMPLARY EMBODIMENTS OF THE INVENTION: 

The present invention relates to a system to enable a 
user to ask a question (query) and for providing the user 
with one or more answers or solutions to such question. 
Since the system according to the principles of the present 
invention processes a query and generates answers employs 
the same methods regardless of the query format (X-A-O) , 
(S-X-X), (S-X-O), or (S-A-X), where "X" is the absence of 
an element, and responds with answers in preferably (S-A-O) 
format, only the processing of query format (X-A-O) will be 
described in detail below but it will be understood that 
such processing applies to the other query formats as well. 

The present system includes software for processing 
such query into, EG, Action-Object (A-0) format and 
includes a knowledge base or database into which a 
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plurality of documents or other information have been or 
shall be semantically processed which knowledge base or 
database associates a plurality of solutions or subjects 
(S's) in association with specific A-0' s as well as links 
for each A-0 to the source document in which the A-0 
appears. The database can be server resident and in 
response to a user A-0 query, transmits to the user some or 
all of the solutions stored in association with the 
specific A-0 query. If no solutions (S's) reside in the 
database, the system searches the web for available web 
data, finds one or more entries (hereafter -"documents") 
with relevant S-A-O, updates the database by storing the 
query A-0 and particular S in association with the stored 
query A-0 along with a link to the source document and 
transmits the answer (S) or answers (Si, S2,...) to the user. 
Preferably, as seen in the word examples below, the answers 
are conveyed in S-A-0 format for the user's convenience and 
reminding user of the query user submitted, particularly 
since the Web search may take a few minutes and the system 
calls the user back with an answer a described below. 
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In addition to user being able to use user's PC 
keyboard or mouse to initiate a query, a key feature of 
exemplary embodiments according to the principles of the 
present invention, enables user to use an ordinary 
telephone or cellular phone to access and query the system 
verbally and to receive an audio or visual display response 
containing the answer or solution. 

An alternate feature of an alternate embodiment 
includes including in the user telephone or cellular phone 
a micro chip bearing software that converts voice to 
digital text, processes the query into A-0 format, accesses 
the database server via the web, receives the solutions or 
answers from the web based server, converts it from text to 
synthesized voice or visual display data for user 
perception at users hand unit. 

Other and further objects, benefits, and features 
shall become apparent with the following detailed 
description and drawings. 
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DESCRIPTION OF DRAWINGS: 

Figure 1 is a schematic representation of a system 
according to the principles of the present invention. 
Figure 2 is a block diagram of the principal steps and 
elements of the system of Figure 1. 

Figure 3 is similar to Figure 2 showing an alternate 
embodiment of the present invention. 

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS OF THE INVENTION 

One example of a Semantic Answering System (SAS) 
according to the principles of the present invention 
includes voice-to-text transformation device or/and 
software system, client software module, a server storing 
the knowledge base or database of semantically created 
answers . 

A user asks a question by voice, using microphone or 
telephone; the sound is transformed into text by software 
or special semantic chip, which is able to recognize the 
question. For example, the user asks, "How can I reduce 
cholesterol?" Text-to-voice device or software transforms 
sound into a text file as a query. One exemplary method of 



achieving this is disclosed in U.S. Patent Application SN. 
09/815,260 filed 3/22/01. The Client software module adds 
URL to the query; URL/query is sent over the World Wide Web 
to the Server, which contains the knowledge base of 
semantic index in Subject-Action-Object format. 

Examples of semantic Index: 

Assume the following are stored in the index: 

Dietary measure - reduce - cholesterol saturation; 

(51) (A) (O) 

Clofibrate - reduce - cholesterol. 

(5 2 ) (A) (0) 

The server searches the database for (Ss) answers 
which match the query, EG, (A-O) and transmits them in HTML 
format over the Internet back to client software module, 
where A-O and answers (Si and S2) are transformed into text 
files. Text files are transformed into voice by text-to- 
voice device or/and software system such as digital 
computer . 

Alternately, if there is no answer in the database to 
the user query (A-O) , semantic indexing engine processes 
the Web to find and retrieve relevant documents, then 
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creates subject-action-object entries index and sends the 
index entries over the Internet. 

Generally, the following signal transformations occur: (See 
Fig 1) 

User asks a question to a microphone 1. 

The software or the hardware-level apparatus 2 
converts the voice data stream into a plain text. 
Alternatively, user with the aid of keyboard, scanner, or 
other input device 3 may enter plain text. 
Problem statement is extracted from the plain text. The 
format of the problem statement is Action-Object (A-0) . 
Client software 4 codes the Problem statement as parameter 
of the URL query. 

URL Query 5 is sent over the World Wide Web to the 
Semantic Server. 

The Semantic Server 6 searches for the available 
solutions in the semantic database. One example of a 
Semantic S-A-0 processing method is disclosed in U.S. 
Patent Application SN. 09/541,182 filed April 3, 2000. If 
solutions (answers) exist, they are returned in HTML 
format. The representation of the solutions is basically 
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Subject-Action-Object (S-A-O) . If solution is not found in 
the Semantic Database 7 , additional search on the WWW is 
performed. User will be later notified about the results. 
The search can be performed on a regular basis to 
accommodate the changes of the Internet. 

The solutions are filtered by server 6 or the user PC 
or device and can be stored on the User PC. The links to 
the source documents can be stored in the Semantic database 
or client PC, as well. User can be notified by email that 
there are new solutions to his (her) problems in the 
Semantic Database . 

Text-to-Voice module 1 generates the audio stream from 
the filtered solutions. 

User listens to the answers in sequential order to the 
user's query. 

On the whole, the SAS 10 delivers the answers to the 
user's questions. Answers can also be visually displayed 
or printed out as desired by user's PC. 

If the current database does not contain solutions to 
the user's problem, the Semantic Server performs a Web 
search. The results are converted to the Subject-Action- 
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Object format. The components of the semantic database 
index are updated. The user may be notified about solution 
availability by, but not limited to, one of the following 
methods : 

1. During the next interaction with SAS 

2 . Over the telephone 

3. Over email 

4 . Over a pager 

The components of SAS are (The following numbers relate to 
the blocks of Fig. 2) : 

21. User. The user asks the questions and receives 
the answers to these questions. 

Output: Question containing a problem that is 
expressed in user voice, or as result of interaction 
with User PC through microphone, keyboard, scanner, 
etc. 

22. Voice Receiver. VR converts the user voice to the 
electrical signals. Examples include headset 



microphone, telephone microphone, etc. The component 

includes also the sound card if it is used with the 

computer . 

Input: User voice 

Output: Voice stream 

23. Voice Recognition Software. This software 
converts the signals coming from the Voice Receiver 
into plain text. Examples of Voice Recognition 
Software include, but not limited to ViaVoice™ 
software from IBM Corporation, or Dragon 
NaturallySpeaking from Dragon Systems. 

Input: Voice stream 

Output: Plain text that corresponds to the user's 
voice . 

24. Client Software Module. Component 24 represents a 
module for generating queries to be sent over the 
Internet. The Module formulates a problem contained in 
the user's question. Format of the problem is Action- 
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Object (A-O) . This module also supports plain text 
input as an extra functionality. 
Input: Plain text 

Output: Problem statement in form Action-Object. 

25. Internet Connection. Module 25 converts Action- 
Object problem statement into URL that is transmitted 
over one of the following connections, but not limited 
to Network Connection, Modem Connection, and Wireless 
Connection. The additional parameters of the URL may 
include use synonyms and constraints with the Semantic 
Server. See U.S. Patent Application SN. 09/785,018 
filed 2/16/01 and 09/814,698 filed 4/24/01. 

Input: Problem statement in form Action-Object. 
Output: URL. 

26. Semantic Server/Semantic Database. Semantic 
server 26 intercepts the URL. Parameters of an URL 
define the algorithm of the server functioning. In a 
general case the semantic server generates SQL query 
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understandable by Semantic Database. See for example: 
www . cobrain . com 
Input: URL. 
Output: SQL Query. 

27. Semantic Database /Semantic Server. Semantic 

Database or Knowledge Base 27 stores the available 
solutions to the users' problems (A-O's). The database 
content is periodically updated. Content is optionally 
updated based in the users' requests. The solutions 
are stored in the form Subject-Action-Object. If 
Action-Object problem statement has similarity with at 
least one of the Subject-Action-Object solution, then 
it is retrieved from database 27. The maximal number 
of the solutions is indicated as one of the URL 
parameters. The results are presented as the 
recordsets. Semantic Server transforms these 
recordsets to the HTML pages. 
Input: SQL Query. 
Output: HTML page. 
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28. Internet Connection. Internet Connection 28 
delivers the Web page containing solutions in HTML 
format to the Client computer or device resident 
Software Module which transforms the HTML format into 
plain text format. 

Input: HTML page. 
Output: Plain text. 

29. Client Software Module. The module filters out 
the results. One of the following, but not limited to, 
set of filters may be applied: Subject length, 
specific terms (such as stop words "be" "is", etc.), 
number of solutions, etc. The results may be in 
Subject-Action-Object format, or may contain the 
source sentences. The following information can be 
stored at the User PC: 

• Result as Subject-Action-Object; 

• Sentence of the source document that contains 
this result; 

• [Hyper] link to the source document. 

The filters that can be used for voice output are: 
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• Subject or Object are too long 

• The total S-A-0 length is too long 

The user is notified if there are more results than 
allowed to be spoken. 
Input: Plain text. 
Output: Plain text. 

As an alternative, this filtering function can be 
resident in the semantic server block 26 so that only 
filtered answer data are conveyed to the user's 
computer . 

0. Voice Generation Software. The text of the answer 
passes through Voice Generation Software 30 (examples 
are ViaVoice software from IBM Corporation, or Dragon 
NaturallySpeaking from Dragon Systems) . 

Input: Plain text. 
Output: Voice signal. 

1. Speaking Device. Speaking Device 31 delivers the 
voice to the user by generating audio frequency waves. 
Examples include, but not limited, to telephone or 
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cell phone speaker, computer speaker, or headset 
speaker. The component includes also the sound card if 
it is used with the computer. 
Input: Voice signal. 
Output: Audio signal. 

Examples of User- SAS Interaction 

Example 1. The solutions for the user problems are found in 
the Semantic Database. 



Step No. 1 SAS: 

"Hello, Dr. Smith !" 

Step No. 2 User: 

"How can I reduce cholesterol?" 

Step No. 3 SAS: 

"Reduce cholesterol?" (pause) 

Step No. 4 SAS: 

"Dietary measure-reduce-cholesterol saturation 
"Clof ibrate-reduce-cholesterol" 

"Saturation - reduce - serum cholesterol level' 
"Talk with you later" 
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Step No. 5 User: 

"Hello?" 

Step No. 6 SAS: 

"Yes, Dr. Smith!" 

Step No. 7 <Going to step 2 user asks another question> 

Example 2. The solutions for the user problems are not 
found in the Semantic Database. 

Step No. 1 SAS: 
"Hello, Dr. Smith!" 
Step No. 2 User: 

"How to cure West Nile encephalitis?" 
Step No. 3 SAS: 

"Cure West Nile encephalitis?" (pause) 
Step No. 4 SAS: 

"Currently there are no solutions of the problem "Cure 
West Nile encephalitis" in Semantic Database. Do you want 
to initiate the search over the Internet?" 
Step No. 5 User: 
"Yes" 
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Step No. 6 SAS: 

"I will inform you when the solution becomes available. 
Talk with you later. " 

Step No. 7 SAS continues to search for solutions. The 
solutions for the user problem later appear available in 
the Semantic Database. 
SAS calls to the user: 
Step No. 8 SAS: 

"Hello, Dr. Smith! 10 minutes ago you were interested in 
the problem "Cure West Nile encephalitis" . Currently we 
have the following solutions: 

a . X cures West Nile encephalitis. 

b. Y cures West Nile encephalitis. 

c. Z cures West Nile encephalitis. " 

As mentioned above, the SAS can handle different types 
of formatted queries. For example, each of the following 
would respond to user as above. 
Different types of formatted questions. 
Example 3. (S-A-X) query format 

Question: What does aspirin cause? 

S -aspirin, A-cause 
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Answers : 

a. Aspirin - cause - gastric damage 

b. Aspirin - cause - stomach bleeding 

c. Aspirin - cause - stomach irritation 
Example 4. (S-X-X) query format 

Question: What does aspirin do? 
y S-aspirin 
^ Answers ; 

%^ a. Aspirin - reduce - headache 

..n b. Aspirin - prevent - pregnancy loss 

%*k c. Aspirin - reduce - risk of cataract 

|^ development 

0 Example 5. (S-X-O) query format 

Question: What are the relations between 
aspirin and asthma? 

S- aspirin, O-asthma 

Answers : 

a* Aspirin - induce - asthma 

b. Aspirin - trigger - asthma attack 
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ALTERNATE EMBODIMENT: 

An alternate embodiment is shown in Figure 3 in which 
user PC or device transmits the query in plain text. The 
query is processed and the problem statement generated in 
server 36 and the SAO, whether stored in database 27 or 
acquired from the World Wide Web and stored in database 27, 
is transmitted HTML page by server 36. The remainder of 
the system functions as mentioned above with this 
arrangement, all semantic software and problem - solution 
statements processing is located at the server instead of 
each users apparatus. 

Possible Applications : 

Semantic chip for mobile and other devices. 

This chip delivers the following functionality: 

• Speech to Text Conversion 

• Problem Statement based on the semantic algorithms 

• Transmission of the problem through the web to the 
Semantic Server 

• Receiving of the solution from the Semantic Server 
through the web 
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* Solutions filtering 

• Text to Speech conversion 

This corresponds to the Fig 2 components 23, 24, 25, 28, 
29, and 30 preferably in one chip as the users terminal or 
cell phone. Alternately, filtering can be done at the 
Semantic Server instead of the user's PC or chip. 

Self-Growing Semantic Networks 

Whenever each user asks the SAS a new question or new 
solutions to old questions appear in the Semantic Server, 
the server adds them to the Semantic database. As Semantic 
Database grows and stores more and more content S-A-O's, 
the probability of the available solution increases over 
time . 

Semantic Updating or News Networks 

Example 3. Original user is interested in the 
specific problem A-O. After initially serving the original 
user, the Semantic Server continues to track the appearance 
of any new S-A-0 solutions that did not exist in the 
database before the original user was served. This updating 



22 



happens either on a regular basis or during processing the 
relevant A-0 queries of other users. The original user is 
automatically informed that the new solution is available. 

For details of suitable semantic processing systems 
and the S-A-0 format, see U.S. Patent Application SN. 
09/321,804, filed May 27, 1999 and 09/541,182, filed April 
3, 2000, and the Knowledgist® Software and COBRA1N® 
Software marketed by Invention Machine Corporation of 
Boston, Massachusetts and used to support Invention 
Machine' s website www . cobr ain . com . See also US Pat. 
Application SN: 09/815, 260, filed 03/22/2001 for further SAO 
processing, query recognition, and expanded SAO query 
search capabilities . 

Various improvements and modifications can be made to 
the herein disclosed exemplary embodiments without 
departing from the scope of the present invention. 
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